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Abstract. The evolution of a quantum system, appropriate to describe nano-magnets, can be 
mapped on a Markov process, continuous in /3 . The mapping implies a probability assignment that 
can be used to study the probability density (PDF) of the magnetization. This procedure is not the 
common way to assign probabilities, usually an assignment that is compatible with the von Neu- 
mann entropy is made. Making these two assignments for the same system and comparing both 
PDFs, we see that they differ numerically. In other words the assignments lead to different PDFs for 
the same observable within the same model for the dynamics of the system. Using the maximum 
entropy principle we show that the assignment resulting from the mapping on the Markov process 
makes less assumptions than the other one. 

Using a stochastic queue model that can be mapped on a quantum statistical model, we control 
both assignments on compatibility with the Gibbs procedure for systems in thermal equilibrium 
and argue that the assignment resulting from the mapping on the Markov process satisfies the 
compatibility requirements. 



INTRODUCTION 

The statistical approach of a classical system relies on probability theory through the 
lack of knowledge on the initial conditions, leading to a well known probability as- 
signment within the Boltzmann-Gibbs framework. In a quantum system the evolution is 
inherently stochastic and the knowledge on the initial condition of the system is also in- 
complete. Dealing with the statistical properties of a quantum system the question arises: 
where is the uncertainty in the formulation coming from? Does the generalization of the 
classical approach not give too much importance to the lack of knowledge on the initial 
conditions and do we incorporate correctly the propagation of uncertainty inherent to 
quantum theory? 

It is clear that we will not answer to these questions in general. We will only give a 
few examples that illustrate the key-role played by the probability assignments. We start 
with a probability assignment that is not very well known. For quantum models with a 
finite number or a countable number of states a mapping of the model and its evolution 
expressed by the parameter /3 into a Markov chain with a continuous time dependence 
can be made. The mapping accomplishes the probability assignment: from the transition 
probabilities obtained by solving the Markov chain, the PDF of an observable at /3 can be 
obtained given the initial PDF for the same observable using the Chapman-Kolmogorov 



equation. We will also consider the probability assignment that is compatible with the 
von Neumann entropy by taking the expectation value of an indicator for a specific state 
of the observable. For example assume that the observable M can take the value k and 
consider the indicator J*{M = k). The PDF for a discrete observable M is given by 
[J(M = k)), with (A) = TrAexp(-/3(#-F)) and F, the free energy of the model. 

Once the probability assignments are made the Shannon entropy for both assignments 
can be calculated for the same system and compared. In the case of the mapping on 
the Markov chain the formalism allows a distinction between the uncertainty coming 
from the initial condition and the quantum evolution. In the common quantum statistical 
procedure such a separation of sources of uncertainty is less obvious. It should be noted 
that in both cases the Shannon entropy is calculated. 

The paper is organized as follows, in the next section we give a short review of the 
main points in the mapping that lead to a Markovian representation of the quantum evo- 
lution of the systems. We sketch how it is done for the magnetic cluster and show that the 
stochastic evolution of an M/M/°°-queue and the quantum evolution of a displaced har- 
monic oscillator can be regarded as representations of the same probabilistic system. In 
the following section we compare the Shannon entropy calculated using the probability 
assignment based on the expectation value of an indicator and compare this entropy with 
the Shannon entropy obtained by the Chapman- Kolmogorov equation for the Markovian 
representation of the system. In the last section a discussion on the mapping is given and 
some remarks on the relation between the blocking temperature of the magnetic system 
and the behavior of the entropy in terms of /3 are given. 



THE METHODOLOGY 

In this section we indicate how a mapping on a Markov process helps us to calculate 
the PDF of a set of states | k), the eigenstates of an observable, order parameter etc, 
that undergo an evolution generated by an Hamiltonian. The cyclic property of the trace 
allows you to write the partition function in any complete set of states, taking the states 
| k) the following expression is the expectation value of the indicator J*{M = k) 

(k | exp(-/3//) | k) 
p(k\P) = W) , (1) 

and is a probability assignment. The Shannon entropy calculated using © is sometimes 
called the information entropy JUS]. In ref. |0], we compared the PDF of magnetiza- 
tion based on the assignment CQ) with the PDF based on the Markov representation and 
we found that they are different. In order to indicate the possible origin of this differ- 
ence we briefly indicate the steps necessary to achieve the Markov representation. The 
equivalence in evolution between the quantum system and Markov process depends on a 
mapping of the evolution equations for the states | k) on a backward Kolmogorov equa- 
tion. This allows to use the forward Kolmogorov equation to calculate the transition 
probabilities for evolution between the states. These transition probabilities denoted by 
p(kj5 | k'O) express the probability to observe the system in state | k) given /3 when one 
knows it is in state | k 1 ) initially. For any density of the initial states the final PDF can be 



obtained by conditioning: 



P(k\l3)= 1 £p(kp\k>0)p(k l \0). (2) 

k> 

Our objective is to calculate the probability density of a complete orthonormal set of 
states \k) given some parameter /3. In order to relate this probabilities for different values 
of the parameter we would like to know the conditional probability p(kj5 \ k'j5') where 
/3 > /3'. Let us emphasize that the conditional probability is a logical relation between 
the two states not a causal one. This allows to exchange the states and corresponding 
parameters using Bayes rule and obtain a description valid for /3' > /3. 

We define the following propagator of H, the Hamiltonian that generates the quantum 
evolution: 

K lk (P) = ^(k\exp(-PH)\l), (3) 
gl 

the states \k) are the eigenstates of the operator M not commuting with H. The partition 
function Z(j3) needed to evaluate <HJ can also be calculated from the diagonal elements 
of ©. The propagator © satisfies the following initial condition: lim^ ^Kik (j8) = ca- 
using H\l) = £ \k) (k\H\l) + \l) (l\H\l), the equation of motion of the propagator 

readily obtained: 

dpKik (JS) = £ qi p K pk (J8) - Vl K lk (J8) - V,K lk (J8) . (4) 
p+l 

The following expressions have been introduced: qi p given by — (p\H\l) and v/ = 
£ ^/p while Vi is given by (/ | H \ I) — v/. If the parameters qi p are positive they can be 

considered as rates of a continuous time Markov chain, provided that V/ is identically 
zero. In that case © is a backward Kolmogorov equation of a Markov chain |4j]. If 
Vi is different from and positive, then the introduction of an additional state | c) can 
make © Markovian. This state is called the coffin state, it is a state characterized by 
absorption and has the following properties by definition: 

Xc/(JS) = 0, Kc C (fi) = l, £^(j8)+^ c (j8) = 1. (5) 

Of course we have to check whether the conservation of probability in the presence of 
absorbing states © can be satisfied for all values of /3. The proof goes as follows: firstly 
we introduce the ground state (0 |, secondly we shift the origin of spectrum of H to 
and then we expand the ground state into the complete set (k |: ((j) |= Y,kgk{k |- From the 
conservation of probability follows: gi ^ \ I), and the proportionality factor has to be 
determined by the normalization. 

The positivity of the rates in the Markov process turns out to be the most demanding 
criterion for the existence of the mapping. We do not know the necessary conditions, 
but it is easy to show that the conditions imposed by the Rokhsar-Kivelson mapping are 
sufficient flU. 



The first quantum model that we will study in a Markov representation is used to 
analyze the spectrum of some nano-magnets. It is a finite state system described by the 
following Hamiltonian: 

H = D(S Z ) 2 +E((S X ) 2 - (5>') 2 ) +gn B (t>zS z +b x S x ). (6) 

This model belongs to the class of mean-field models and bears some resemblance with 
the Lipkin-Meshkov-Glick- model [7]. When the Hamiltonian is rewritten in terms of 
spin lowering and raising operators, the generator Q for the continuous time Markov 
process can be calculated using the techniques which are documented in ref. [3]. Cast- 
ing the Markov representation of (|6l) into a matrix equation: dnK{fi) = QK(fi), and 
straightforward matrix methods can be used to obtain K mm >(P). In the spectral represen- 
tation the propagator is given by: 

K mm >(P) = £t/ mv exp(-/3e v )t/ v -;, (7) 

V 

where £ v is the v-th eigenvalue of the generator Q and £// v is an element of the modal 
matrix. The mapping and references to the physical origin of the model can be found in 
the paper: ||3J]. 

The second system is an M /M /°° - queue. In the literature the symbol X /Y /n/K/m/Z 
denotes a random service process in which customers join a queue if all servers are busy, 
with inter-arrival time distribution X, service time distribution Y, number of servers n, 
maximum number of customers allowed in the queue K, number of customers in the 
source m, servicing rule Z yfl. The backward Kolmogorov equation for this system, 
considering an evolution parametrised by /3 is given by: 

d j5 K(n 1 p;n 1 0) = YK(n + l 1 p;n \0)+XnK(n-l 1 j3;n 1 0)-(y+Xn)K(n 1 p;n ',0). (8) 

The parameter 7 is related to the rate that incoming costumers join the queue, while X is 
the rate to get a service for a customer that is in the queue and as a consequence leaves 
the queue. Using the techniques explained in the preceding section it is straightforward 
to show that the equation © is a mapping of a quantum system with the following 
"Hamiltonian" : 

H = XA^A - yA - AAf + 7, (9) 

where the operators A + , A are respectively raising and lowering operators. In the case 
that both rates take the same value, the quantum system turns out to be a displaced oscil- 
lator. The methods to solve equation © are algebraically equivalent to the methods used 
to introduce coherent states J8J]. Firstly a probability generating function is defined in the 
complex plane: E„(z,/3) = Y,kK(n,fl;k,0)z k , secondly the partial differential equation 
for the generating function is derived, and solved using the method of characteristics. 

Making use of an expansion in series the transition probabilities are obtained in terms 
ofg( J 8) = l-exp(-A( J 8))by: 

mm(m,n) / \ ( Y\m-k 

^,/3;m,0) = exp(-|g(/3)) £ [ k ) ~ (s(j6)) n+M ~ 2 *- (10) 



Once the transition probabilities are known the propagation of the lack of knowledge on 
the initial conditions of the quantum system can be studied taking the stochastic nature 
of that evolution fully into account. 



RESULTS AND DISCUSSION 

We compare the Shannon entropy calculated on the basis of the two probability assign- 
ments introduced in the preceding section for the spin model and the M/M/°° - queue. 

S(j3) = -J>(/n|j3)lnp(ro|j3) (11) 
111 

We will indicate the quantities derived using the probability assignment based on the 
mapping into a Markov chain by an index mc while those based on the expectation value 
of the indicator have an index ie. For he spin model we will consider two cases, firstly 
we consider a system consisting of a single large spin, typically used in connection with 
nano-magnets, and indicated by LS. Secondly we will consider the many spin system, 
typically used to calculate the blocking temperature [J] or other phase-transitions ll9L[l0L 
El [H , and indicated by MS. 

For the M/M/°°-queue we will use the maximum entropy principle to show that it 
is able to distinguish between different initial conditions. Furthermore we will calculate 
the Shannon entropy of the queue and of the "quantum" model equivalent to the queue 
and show that the entropies have completely different behavior with respect to /3. In 
other words the predictions based on one of the assignments contradicts the predictions 
based on the other. 

At the end of the section we will draw some conclusions by answering the question: 
what probability assignment is compatible with the probability assignment for a quan- 
tum system in thermal equilibrium II13I1 . the so-called Gibbs assumption? 



The spin model 

The single spin model describes the thermal evolution of a large spin with N + I 
states. We assume that we have no prior knowledge about the preparation and chose 
a uniform density Phsijn | 0) = as an initial condition. In this case equation ® 
) is readily solved and after normalization the entropy can be obtained by evaluating: 
PLSmc( m \ P) x Y*kK(m, j3;k). Also the information entropy can be obtained using 
expression (fTTT) by replacing the expression p(m | /3) by:pisi e {m | /3) AT(m,/3;m). 

In figure we show the result for both probability assignments. From the compari- 
son it is clear that the maximum entropy principle favors the probability assignment that 
incorporates the uncertainty about the initial condition and the stochastic evolution. 

We will compare now the entropy resulting from the two probability-assignments 
that we have used in the single spin model for a system that consists out of N spin j 
sites. The spins can flip up and down according to the stochastic model generated by 
the same Hamiltonian. This model has the same spectrum as the single spin system but 
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FIGURE 1. The entropy of the spin systems. (A): The thermal evolution of the entropy for two 
probability assignments: the curve marked by black squares incorporates the stochastic temporal evolution 
as well as the initial condition for the single spin model S^smc and is compared with the entropy 
SLSie(P) marked by black dots. (B): The thermal evolution for two probability assignments: the curve 
marked by black triangles incorporates the stochastic temporal evolution as well as the initial condition 
for the many spin model SMSmc(P), an d is compared with the entropy SMSie(P) of the same model 
marked by black pentagons. The figure is made using ^ as energy-unit and realistic values for b and 

E,b = E = M%. 



the density of states is different. The multiplicity of a state with quantum number m 
comes from the fact that there are ( N ) realizations of this state. Due to the fact that 
the thermal evolution is independent of the site index the appropriate choice for the 
initial condition is a binomial density: pMs{ m I 0) = („,)• Using this initial condition 
it is straightforward to obtain PMSmc( m I P) and to calculate the entropy (fTTT) . The 
multiplicity of energy levels is taken into account by incorporating it in the probability 
assignment: PMSie( m \ P) 06 {^jK^m, f5;m), and adapting the normalization accordingly. 

The obtained entropies are depicted in figure ©, again it is clear that in the low tem- 
perature phase the maximum entropy principle Ill4ll favors the solution of equation © 
and the appropriate initial condition. In the high temperature phase there is little differ- 
ence between both probability assignments and the principle gives no compelling reason 
to prefer one assignment above the other. However only the Markov representation gives 
in both regimes an entropy that is either maximal or almost numerical equal to the max- 
imum entropy. 



The queue 

According to the generating function of the moments that interpolates for small 
g(/3) ~ from the generating function of a geometric density to that of a Poisson 
density at g(/3) ~ 1, there are two possible candidates for the initial density of the queue 
i.e. the geometric density with a probability proportional to p n and a Poisson density 
exp(— A)^. In case of the geometric initial density we can use the generating function 
of the probability to obtain the solution of equation ©: p geo (n,fi) E„(p,/3) while for 
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FIGURE 2. The entropies of an M/M/°°-queue. In figure (A) the entropies resulting from a probability 
assignment that incorporates the stochastic evolution with two different initial conditions are compared. 
The entropy starting from the Poisson density (black squares) is larger than the entropy starting from 
a geometric density (black dots). In figure (B) the entropies of an M/M/°°-queue based on quantum 
statistical methods are shown. The Shannon entropy (black triangles) is obtained using the probability 
density obtained from diagonal elements of the propagator, the equilibrium entropy (black pentagons) is 
calculated directly from the partition function. 

the Poisson density we have to solve equation © numerically. 

Once the probabilities are known the expectation of their logarithm can be calculated 
to obtain their entropy. The results are shown in figure ©A) and it is evident that the 
thermal evolution of the density with the Poisson density as initial condition leads to the 
maximum entropy. Indeed in the construction of the M/M/°°-queue one assumes that 
the customers enter the facility according to a Poisson density. The initial geometric 
condition introduces a new assumption leading according to the maximum entropy 
principle to a lower entropy. 

Suppose that we insist on the use of the quantum statistical techniques lfl5l fl6l fl7ll 
to make statements about the entropy of the queue. In that case we will employ the 
resemblance with the displaced oscillator and in order to deal with a hermitian model we 
chose the rates A and y equal. We can calculate an entropy using the partition function 
S e q = P(U — F) where U is the internal energy and F is the free energy. Using the 
diagonal part of the propagator: p, e (n, /3 ) K(n, /3 | n, 0) as a probability assignment an 
using expression (fTTT) is also a possibility. 

Both entropies are shown in figure ©B). First we remark that the entropy calculated 
directly from the partition function differs from the Shannon entropy, calculated from the 
diagonal parts of the propagator. Both show a thermal evolution that is in contradiction 
with the thermal evolution of the entropy of the queue. Clearly indicating that the 
probability assignment based on the stochastic evolution of the system is not necessarily 
compatible with the probability assignments often used in their quantum statistical 
counterparts. 



What about Gibbs? 



The analysis of the entropies of the magnetic system could lead to the impression that 
one of the probability assignments leads to a reliable approximation of the other with 
respect to the thermal evolution of the system. The example with the queue excludes 
this impression. Invoking the maximum entropy principle is not adequate because the 
answer would depend on the precise value of /3 at high temperature the entropies shown 
in figure ©B) are larger than those shown in figure (0A) while for low temperatures it 
is the other way around. Therefore we have investigated what assignment is compatible 
with the one Gibbs used in the case of thermal equilibrium. 

Let us consider the spectral representation of the propagator and rewrite equa- 
tion ©: p(m,f3) = Y, v U(m,v)exp(-[5£ v )Y,iU~ 1 (v,l)p(l,0). Introducing w(v,j3) = 
ZiU~ l (v,l)p(l,P) we find that 

w(v,j8)=exp(-jSe v )w(v,0). (12) 

Noting that | v) is an eigenstate of the generator of the Markov process and therefore 
proportional to an eigenstate of the Hamiltonian, we see that equation © is compatible 
with the Gibbs assumption while the probability assignment based on the diagonal part 
of the propagator requires that the states | k) are eigenstates of H in order to achieve 
compatibility. 
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